James Madison, like Washington and Jefferson before him and President Monroe who followed, came from Virginia. It was a state that produced remarkable leaders. The son of one of Virginia's oldest families, Madison grew up at Montpelier and was educated at plantation schools. His family valued education.